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INTRODUCTION 

Can  investment  managers  beat  the  market?   Or  more  specifically, 
can  they  determine  when  a  portfolio  replicating  the  stock  market  as  a 
whole  will  provide  a  greater  return  than  riskless  government  securities? 
Using  a  model  developed  by  Merton  (1979),  we  will  attempt  to  answer 
this  important  question. 

There  have  been  numerous  studies,  both  theoretical  and  empirical, 
dealing  with  the  evaluation  of  the  performance  of  investment  managers. 
This  is  justifiable  considering  the  magnitudes  of  the  invested  assets 
and  management  fees  involved.   Proper  evaluation  v/ould  allow  investors 
to  analyze  the  trade-off  between  expected  fund  performance  and  the 
size  of  the  management  fees,  while  allowing  the  best  managers  to 
charge  the  highest  fees. 

A  second  important  reason  for  study  of  the  subject  is  the  incon- 
sistency of  superior  forecasting  ability  and  stronger  forms  of  the 
Efficient  Markets  Hypothesis.    If  managers  actually  do  possess 
superior  forecasting  ability,  it  can  not  be  true  that  market  prices 
reflect  all  available  information,  assuming  investors  prefer  more  to 
less. 

Forecasting  skills  are  usually  considered  to  be  of  two  forms: 
"micro"  forecasting  and  "macro"  forecasting.   Micro  forecasting 
focuses  on  individual  securities,  seeking  to  determine  securities 
that  are  under-  or  overvalued  in  light  of  the  forecaster's  expectation 

of  future  returns.   In  terms  of  the  Capital  Asset  Pricing  Model  (CAPM) , 

2 

such  securities  would  lie  above  or  below  the  Security  Market  Line. 
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Macro  forecasting  or  market-timing  strategies  attempt  to  determine 

when  the  stock  market  as  a  whole  will  outperform  riskless  securities 

[i.e.,   Z  (t)  >  R(t)]   and  when  riskless  securities  will  outperform 
m  x 

the  stock  market   [i.e.,   Z  (t)  <  R(t)J   where   Z  (t)   is  the  one- 

m  m 

period  per-dollar  return  on  the  stock  market  and   R(t)   is  the  one- 
period  per-dollar  return  on  riskless  securities. 

Treynor  and  Black  (1973)  show  that  through  the  use  of  an  "active" 
portfolio,  investment  managers  can  effectively  separate  actions 
related  to  security  analysis  from  those  related  to  market  timing. 
The  investment  manager's  optimal  portfolio  can  be  thought  of  as  a 
combination  of  three  portfolios:   the  active  portfolio,  a  portfolio 

replicating  the  market  and  a  portfolio  comprised  of  riskless 

3 
securities.   The  active  portfolio   reflects  the  manager's  micro 

forecasts  and  will  be  comprised  of  long  positions  in  securities  that 
are  thought  to  be  undervalued  and  short  positions  in  securities  that 
are  thought  to  be  overvalued.   Knowing  the  composition  of  the  active 
portfolio,  the  manager  will  achieve  the  desired  level  of  market- 
related  risk,  which  will  take  into  account  any  market  timing  forecasts, 
by  adjusting  their  positions  in  the  market  portfolio  and  riskless 
securities. 

In  this  paper,  we  will  focus  on  macro  forecasting  or  market  timing. 
Fama  (1972)  and  Jenson  (1972a)  develop  a  theoretical  structure  for 
evaluation  of  the  performance  of  investment  managers  using  both  micro 
and  macro  forecasting,  based  on  the  ex  post  performance  of  the  manager's 
fund  and, the  market.   Jenson  also  shows  that  there  are  difficulties 
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in  empirically  distinguishing  among  the  individual  contributions  of 
the  two  types  of  forecasts.   Without  knowing  the  actual  forecasts  or 
the  beta  (i.e.,  level  of  market  risk)  of  the  fund  at  each  point  in 
time,  regression  analysis  of  portfolio  returns  cannot  be  used  to 
distinguish  excess  returns  that  are  the  result  of  micro  forecasting 
from  those  that  are  the  result  of  market  timing. 

Jenson  assumes  that  the  market  timer  forecasts  what  the  return 
on  the  market  portfolio  will  be  and  adjusts  his  portfolio  accordingly. 
The  magnitude  of  the  adjustment  will  be  a  function  of  the  level  of 
his  forecast  and  the  risk  preferences  of  the  fund's  investors.   Their 
risk  preferences  will  in  part  reflect  the  volatility  of  market  returns. 
The  higher  the  estimate  of  the  market  return,  the  greater  the  amount 
of  market-related  risk  they  will  be  willing  to  bear.   Jensen  shows 
that  a  market  timer's  forecast  can  be  measured  by  p,  the  correlation 

between  the  market  timer's  forecast  and  the  actual  performance  of  the 

4 
market.    The  expected  return  of  the  fund  will  increase  as   p 

increases.   This  is  because  one  would  expect  a  greater  proportion  than 

average  of  the  fund's  assets  to  be  invested  in  the  market  portfolio 

when  the  realized  return  on  the  market  was  greater  than  the  average 

and  a  greater  proportion  than  average  of  the  fund's  assets  to  be 

invested  in  riskless  securities  when  the  realized  return  on  the  market 

was  less  than  the  average. 

Grant  (1977)  explains  how  market  timing  actions  will  effect 

the  results  of  empirical  tests  that  focus  only  on  micro  forecasting 

skills,   when  the  true  forecasts  are  not  known.   He  shows  that  market 
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timing  ability  will  cause  a  downward  bias  in  estimates  of  the  excess 
returns  resulting  from  micro  forecasting  ability.   All  of  these 
studies  use  a  parametric  structure  assuming  a  CAPM  framework. 

Treynor  and  Kazuy  (1966)  use  a  CAPM  framework  with  a  quadratic 
term  to  test  for  market  timing  ability.   In  the  standard  regression 
equation,  a  portfolio's  return  is  a  linear  function  of  the  return  on 
the  market  portfolio.   However,  if  the  portfolio  manager  can  forecast 
market  returns,  he  will  hold  a  greater  proportion  of  the  market 
portfolio  when  the  return  on  the  market  is  high  and  a  smaller  propor- 
tion when  the  market  return  was  small.   Thus,  the  portfolio  return 
would  be  a  non-linear  function  of  the  market  return.   Using  annual 
returns  for  57  open-end  mutual  funds,  they  find  that  only  one  of 
the  funds  can  reject  the  hypothesis  of  no  market-timing  ability  at 
a  95%  confidence  level. 
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THE  MODEL 

Morton  develops  a  model  that  does  not  depend  on  CAPM.   It  takes 
the  simple  form  that  the  investment  manager  either  forecasts  that 
stocks  will  outperform  riskless  securities  or  that  riskless  securities 
will  outperform  stocks.   Based  on  his  forecast,  the  investment  manager 
will  adjust  the  relative  proportions  of  the  market  portfolio  and  risk- 
less securities  that  he  will  hold  in  his  fund.   A  perfect  forecaster 
(who  cannot  borrow  or  sell  short)  will  always  invest  all  of  his  assets 

in  the  market  portfolio  if   Z  (t)  >  R(t)   and  all  of  his  assets  in 

M 

riskless  securities  if   Z  (t)  <  R(t) . 

M 

Merton  (1979)  shows  that  the  return  from  successful  market  timing 
will  be  virtually  indistinguishable  from  certain  option  investment 
strategies  (either  a  strategy  of  holding  call  options  and  treasury 
bills  or  a  strategy  of  holding  protective  put  options  and  the  stock) . 
The  value  of  market  timing  ability  can  be  determined  using  methods 
for  valuing  options. 

The  key  factors  in  determining  the  value  are  the  sum  of  the  condi- 
tional probabilities   [p  (t)  +  p_(t)]   and  the  magnitude  of  the 
portfolio  change  in  response  to  the  market-timing  forecast.   The 
probabilities  are  conditional  on  what  the  market  does.   Given  that 
Z  (t)  <_  R(t),   p  (t) 

is  the  conditional  probability  of  a  correct  forecast.   Given  that 
ZM(t)  >  R(t),   p2(t)  is 

the  conditional  probability  of  a  correct  forecast. 

The  conditional  probabilities  are  segmented  around  R(t)   as 
this  is  the  optimal  switching  point  between  stocks  and  bonds.   Since 
superior  market  forecasting  ability  is  inconsistent  with  an  efficient 
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markets  equilibrium  for  security  prices,  for  such  an  equilibrium 
to  exist,  it  is  necessary  that  an  investment  manager's  forecast 
have  no  value. 

Merton  (1979)  proves  that  a  necessary  and  sufficient  condition 
for  market-timing  forecasts  to  have  value  is  p  (t)  +  P-,^^    >  -*■  • 
With  rational  investors,  it  should  never  be  true  that  p   +  p  <  1 
as  the  opposite  of  the  forecasts  would  result  in  p   +  p„  >  1   and 
would  thus  have  value.   Thus,  a  simple  test  of  a  forecaster's  market 
timing  ability  is  to  estimate  p  +  p~   and  determine  if  one  can 
reject  the  null  hypothesis  that  p  +  p  =  1.   This  is  a  test  of 
independence  between  the  market  timer's  forecast  and  whether  or  not 
the  return  on  the  market  portfolio  is  greater  than  the  return  on 
riskless  securities. 

An  unconditional  probability  of  a  successful  forecast  p  >  0.5 
is  not  a  necessary  or  sufficient  condition  for  a  forecaster's  market 
timing  ability  to  have  value,  as  is  shown  in  Merton  (1979) .   There 
is  one  exception  to  this.   One  can  use  the  unconditional  probability 
of  a  successful  forecast  if  there  is  good  reason  to  believe  that 
p  =  p  ,  i.e.,  the  forecaster  has  the  same  ability  at  predicting 
up-markets  as  down-markets. 

The  use  of  this  nonparametric  test  eliminates  the  empirical 
problem  that  extreme  outcomes  can  swamp  the  results  in  estimating 
a  regression  equation,  without  eliminatimg  them  from  the  sample. 
Differences  between  our  non-parametric  test  and  estimations  of  Jenson's 
p  are  caused  by  differences  in  the  weightings  of  actual  market 
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outcomes.   Jenson's  test  gives  a  larger  weighting  to  extreme  outcomes, 
while  our  test  weighs  all  outcomes  equally. 

Since  the  volatility  of  stock  market  returns  is  large  relative 
to  the  expected  return  over  short  time  periods,  it  would  be  quite 
difficult  to  attach  much  accuracy  to  point  estimate  forecasts.   For 
quarterly  data  from  1926:1  to  1978:4,  the  average  three-month  rate 
of  return  was  2.7%  with  a  standard  deviation  of  12.6%. 

Our  nonparametric  formulation  characterizes  a  more  subjective 
approach  to  market  timing;  one  where  the  forecaster  predicts  only  if 
stocks  will  provide  a  greater  return  than  bonds,  but  not  by  how  much. 
It  is  this  forecasting  ability  that  we  will  examine. 
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ESTIMATION 

To  test  for  market  timing,  we  will  examine  the  null  hypothesis 
that  the  timer  has  no  forecasting  ability,  i.e.,   H  :   p   +  p2  =  1, 
where  p   and  p„   are  not  known.   We  want  to  determine  the  prob- 
ability,   P,  that  a  given  outcome  from  our  sample  came  from  a  population 
that  satisfies   H  .   Define  the  following  variables: 

N   E  Number  of  observations  where   Zw  <  R. 

1  M 

N„  E  Number  of  observations  where   Zw  >  R. 

2  M 

N   E  N   +  N  . 

n   E  Number  of  successful  predictions,  given   Z   <  R. 

n9  E  Number  of  unsuccessful  predictions,  given   Z   >  R. 

n   En   +  n„  =  number  of  times  forecasted   Z,,  <  R. 
12  M 


From  our  null  hypothesis,  we  have  that   E(n  /N  )  =  p   and 

E(n„/N„)  =  1  -  p   =  p   where  E   is  the  expected  value  operator. 
2   2         2      1 

Ho 

It  then  follows  that   E(n/N)  =  p  =  p.   Both   n  /N   and   n2/N2   have 

the  same  expected  value  yet  they  are  drawn  from  independent  subsamples. 

Both  n   and   n„   are  random  variables  from  binomial  distribu- 

tions.   Because  of  this,  the  probability  that   n.  =  x   from  a 

subsample  of   N.   drawings  is: 

/NA  N.-x 

P(x;N.,p)  =1    )pX(l  -  p) 
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Given  H  ,  we  can  use  Bayes'  Theorem  to  determine  the  probability 
that  n  =  x  given  N  ,  N2,  and  n,  i.e.,  P(n  =  x|n  ,N2,n).  Assume 
that  B:   n  =  x  and   n  =  m  -  x;  and  A:   n  =  m.   By  Bayes'  Theorem: 


P(B|A)  =   P(B+A)  =  PjB| 
1         P(A)      P(A) 


(?)(::) 


N  -x  N„-m+x 

P  (1  -  P)       p     (1  -  p) 


(I) 


m . ,     . N-m 
p  (1  -  p) 


0 


which  follows  a  hypergeometric  distribution  and  is  independent  of  p. 
Given  N  ,  N„,  and   n,  one  can  determine  the  probability  distri- 
bution of  n  ,  realizing  that  the  feasible  range  for   n   is: 

Max[0,n  -  N  ]  £  n  <  Min[N  ,n] 

Thus  we  can  use  the  distribution  of  P(n  =  x|n  ,N„,n)   over  the 
feasible  range  to  establish  confidence  intervals  for  the  null 
hypothesis.   This  is  straightforward  for  small  samples  as  the 
calculations  can  be  done  using  factorials  (i.e.,  gamma  functions). 
However,  for  large  samples,  the  calculations  may  become  quite 
cumbersome.   Fortunately,  for  large  samples,  the  hypergeometric  dis- 
tribution can  be  approximated  by  the  normal  distribution.    From  the 
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Nl 

hypergeometric  distribution,   E(n  )  =  n  •  —      and  the 

2,   .       N  N  -  N,  N  -  n 

variance  of   n  ,  o  (n  )  =  n  •  _J_. 1« 

N    N    N  -  1 
Our  test  of  the  null  hypothesis  is  a  one-tailed  test.   This  is 

because  of  our  rationality  assumption  that  p  +  p  >_  1.   Thus,  our 

null  hypothesis  can  only  be  rejected  in  the  right-hand  tail  of  the 

hypergeometric  distribution.   By  considering  only  one  tail,  we  are 

making  it  easier  to  reject  the  null  hypothesis,  either  at  the  95% 

or  99%  confidence  level. 

If  we  wanted  to  test  for  market  timing  using  the  unconditional 

7 
probability  of  a  correct  forecast,   then  our  null  hypothesis  would  be 

H  :   p  =  0.5.   The  distribution  of  outcomes  drawm  from  a  population 

that  satisfied  H   would  be  the  binomial  distribution: 

/    1  k     /■,  xN_k 

P(k,N,p)  =1    Ip   •  (1  -  p) 


( 


(0.5)N 


where   k   the  number  of  successful  predictions,   N   is  the  total 
number  of  observations,  and  p   is  the  unconditional  probability  of 
a  successful  forecast. 

Tables  1-3  give  values  of  n   that  reject  the  null  hypothesis  at 
the  99%  confidence  level  for  different  values  of   N  ,  N_ ,  and  m.   As 
would  be  expected,  the  required  estimated  value  of  p  (t)  +  P2(t) 
decreases  as  the  size  of  the  total  sample  increases.   Tables  1-3  also 
show  that  the  normal  distribution  is  an  excellent  approximation  for 
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determining  the  confidence  intervals  for  the  hypergeometric  distribu- 
tion, even  for  observation  samples  as  small  as  50. 

Figures  1  and  2  show  the  relationship  between  the  required  number 
of  correct  forecasts  using  conditional  probabilities  and  unconditional 
probabilities  for  sample  sizes  of  30  and  200  for  different  values  of 
N   and   n. 
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THE  TESTS 

g 

As  most  funds  do  not  explicitly  claim  to  undertake  market  timing, 
it  is  necessary  to  have  the  data  itself  signal  the  investment  manager's 
forecast  of  how  the  stock  market  will  perform.   In  a  Capital  Asset 
Pricing  Model  type  world,  a  measure  of  this  would  be  changes  in  the 
3   of  the  fund.   However,  as  many  of  the  funds  hold  more  than  one 
hundred  different  securities,  this  would  be  difficult  to  determine 
from  the  raw  data,  especially  when  one  considers  that  the  3   of  the 
individual  securities  may  be  changing  over  time. 

Instead,  changes  in  the  relative  proportions  of  the  funds  in 

9 
stocks  and  bonds   are  used  as  the  proxy  for  the  market  timing  fore- 
cast.  When  one  considers  the  frequency  with  which  investors  move  in 
and  out  of  mutual  funds,  it  is  likely  that  open-ended  mutual  funds  are 
constantly  receiving  new  cash  or  selling  off  securities  in  order  to 
redeem  shares  in  the  mutual  fund  being  cashed  in.   This  gives  the 
managers  of  mutual  funds  the  opportunity  to  change  the  level  of  market- 
related  risk  in  their  funds,  at  least  to  a  limited  amount,  at  a  very 
low  marginal  cost  as  the  transactions  costs  involved  would  have  been 
incurred  regardless  of  the  market  timing  action. 

Any  time  a  manager  is  changing  the  level  of  market-related  risk 
in  his  fund,  he  is  implicitly  undertaking  a  market  timing  strategy  as 
he  is  changing  the  risk  characteristics  of  the  fund.   Treynor  and 
Black  (1972)  have  shown  that  managers  can  incorporate  micro  forecasts 
into  their  portfolios  in  a  manner  which  does  not  effect  the  level  of 
market-related  risk  in  the  portfolio.   Black  (1976)  has  also  shown 
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that  it  is  inefficient  to  undertake  a  market  timing  strategy  if  one 
has  no  ability  to  forecast  the  relative  performance  of  the  stock 
market.   Such  a  strategy  would  cause  the  forecaster's  portfolio  to 
have  greater  variance  for  a  given  expected  return  than  a  passive 
(with  respect  to  market  timing)  strategy.   Black  refers  to  this  as 
the  loss  of  time  diversification. 

Thus,  changes  in  the  level  of  market-related  risk  in  a  mutual 
fund  should  reflect  some  expectation  of  how  the  market  will  perform. 
Merton  (1979)  has  shown  that  for  an  individual  with  no  market  timing 
ability,   p  (t)  +  p~(t)  -  1.   From  this,  even  if  we  include  in  our 
sample  funds  which  are  not  attempting  to  forecast  market  performance, 
for  whom  changes  in  the  proportions  of  their  fund  held  in  stocks  and 
bonds  are  independent  of  market  expectations,  this  will  not  bias  our 
results.   And  as  almost  all  the  funds  in  the  sample  have  a  number  of 
quarterly  changes  of  greater  than  two  percent,  it  can  be  argued  that 
most  of  the  funds  are  undertaking  some  implicit  strategy  of  market 
timing. 

Five  different  tests  of  market  timing  were  run  using  quarterly 
data  spanning  the  period  from  March  31,  1973-March  31,  1980.   The 
tests  were  run  on  each  of  186  mutual  funds.     Over  this  period,  the 
return  on  the  market  exceeded  the  riskless  rate  in  15  of  the  28 

quarters.   The  return  from  investing  $1  in  the  market  portfolio  L  for 

12 
the  28  quarters  was  $1.23.   For  U.S.  Treasury  bills    the  return  was 

$1.62.   A  perfect  market  timing  strategy  on  a  quarterly  basis  would 

have  returned  $4.31. 
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The  tests  were  also  run  using  six-month  time  intervals,  running 
from  September  30,  1973-March  31,  1980.   Over  this  interval  the  return 
on  the  market  exceeded  the  return  from  the  riskless  asset  during  5 
of  the  13  six-month  periods.   The  return  from  investing  $1  in  the 
market  portfolio  for  the  13  periods  was  $1.23.   The  return  on  U.S. 
Treasury  bills  was  $1.56.   A  perfect  market  timing  strategy  on  a 
semi-annual  basis  would  have  returned  $3.30. 

To  define  the  tests  that  were  run,  let  y (t)  E  the  market  timer's 

forecast  where  y(t)  =1   if  the  forecast  is   Z  (t)  >  R(t)   and 

M 

y(t)  =0   if  the  forecast  is  that   Z  (t)  <  R(t) .   The  tests  run  were 

M 

as  follows: 

Test  #1:   y(t)  =  1   if  the  proportion  of  the  fund  in  stocks  increases; 
y (t)  =0   if  the  proportion  of  the  fund  in  bonds  increases. 

Test  #2:   y(t)  =  1   if  the  proportion  of  the  fund  in  stocks  increases 

by  one  percent  or  more  of  the  total  value  of  the 

fund; 
y(t)  =0   if  the  proportion  of  the  fund  in  bonds  increases 

by  one  percent  or  more  of  the  total  value  of  the 

fund. 
There  is  no  forecast  if  neither  porportion  increases  by  one 
percent  or  more. 
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Test  #3:   y(t)  =1   if  the  proportion  of  the  fund  in  stocks  increases 

by  two  percent  or  more  of  the  total  value  of  the 

fund; 
y(t)  =0   if  the  proportion  of  the  fund  in  bonds  increases 

by  two  percent  or  more  of  the  total  value  of  the 

fund. 
There  is  no  forecast  if  neither  proportion  increases  by 
two  percent  or  more. 

Test  #4:   y(t)  =  1   if  the  proportion  of  the  fund  in  stocks  increases 

by  one  percent  or  more  of  the  total  value  of  the 

fund; 
y(t)  -  0   if  the  proportion  of  the  fund  in  bonds  increases 

by  one  percent  or  more  of  the  total  value  of  the 

fund; 
y(t)  =   (t  -  1)     if  neither  proportion  increases  by  one 

percent  or  more. 

Test  #5:  y(t)    =1   if  the  proportion  of  the  fund  in  stocks  increases 

by  two  percent  or  more  of  the  total  value  of  the 
fund ; 

y(t)  =  0   if  the  proportion  of  the  fund  in  bonds  increases 

by  two  percent  or  more  of  the  total  value  of  the 
fund; 
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y(t)  =  y(t  -  1)     if  neither  proportion  increases  by  two 
percent  or  more. 

Test  #6  is  the  same  as  Test  #1  for  six-month  forecast  intervals. 
Test  #7  is  the  same  as  Test  #2  for  six-month  forecast  intervals. 
Test  #8   is  the  same  as  Test  #3  for  six-month  forecast  intervals. 

There  are  two  major  reasons  for  using  quarterly  data.   First,  it 
is  the  shortest  time  interval  for  which  data  could  be  obtained. 
Second,  it  is  sufficiently  long  enough  to  allow  managers  of  the  funds 
to  react  to  fluctuations  in  market  values.   Changes  in  the  proportions 
of  stocks  and  bonds  in  the  funds  caused  by  changes  in  the  market  values 
of  the  individual  securities,  and  the  resulting  change  in  the  funds' 
market-related  risk,  could  be  offset  by  the  managers  of  the  funds  if 
they  desired. 

The  use  of  a  filter  band  in  some  of  the  tests  allows  for  the 
possibility  that  changes  in  market  values  occurred  just  previous  to  the 
observation  dates,  or  were  small  enough  that  it  would  not  be  worth 
incurring  the  transactions  costs  to  make  the  necessary  adjustments. 
Since  the  size  of  the  bands  is  small,  a  manager  who  thought  he  could 
predict  the  performance  of  the  market  would  surely  adjust  his  portfolio 
weights  by  more  than  one  or  two  percent. 

Tests  #4  and  #5  allow  for  the  possibility  that  the  range  over  which 
a  manager  can  vary  the  proportions  of  stocks  and  bonds  in  a  fund  are 
limited.   This  could  be  the  result  of  restrictions  imposed  as  a  matter 
of  fundamental  policy  or  as  a  requirement  for  maintaining  tax- 
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exeraption  for  distributed  income.   An  example  of  a  fund  where 
restrictions  would  be  relevant  would  be  Merton's  hypothetical  fund 
which  was  either  100  percent  in  stocks  or  100  percent  in  bonds.   If 
the  forecast  stayed  the  same  as  in  the  previous  period,  the  position 
of  the  fund  would  not  change. 

Three  of  the  tests  were  run  using  six-month  forecast  intervals 
as  well  as  three-month  forecast  intervals  to  consider  the  possibility 
that  fund  managers  do  have  market  timing  ability,  but  they  either  have 
a  longer  forecast  horizon  than  three  months  or  quarterly  intervals 
do  not  give  them  sufficient  time  to  adjust  their  portfolios. 
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TEST  RESULTS 

The  results  of  the  tests  are  shown  in  Table  4.   It  is  clear  that 
we  cannot  reject  the  null  hypothesis,   H  :   p  (t)  +  p  (t)  =  1,  for 
any  of  the  eight  tests.   Only  one  fund  in  only  one  of  the  tests  had 
an  estimated  p  (t)  +  p_(t)   that  differed  from  H   with  99  percent 
probability.   We  would  expect  to  observe  more  outliers  than  this  from 
random  sampling  from  a  population  that  satisfies   H  .   The  same  is 
true  for  the  95  percent  confidence  level.   At  the  most,  five  of  the 
more  than  180  funds  could  reject  the  null  hypothesis  with  95  percent 
probability  in  any  of  the  tests. 

Our  tests  also  show  no  evidence  that  investment  managers  have  a 
longer  forecast  horizon  than  three  months.   When  we  lengthen  the  fore- 
cast period  to  six  months,  in  all  three  cases  our  estimation  mean 
falls  below  one,  none  of  the  funds  can  reject  the  null  hypothesis  with 
99  percent  probability,  and  at  most  four  of  the  funds  can  reject  the 
null  hypothesis  with  95  percent  probability. 

One  problem,  which  occurs  especially  in  Tests  #3  and  #8,  is  that 
the  use  of  a  filter  makes  the  number  of  usable  observations  become 
quite  small  for  some  of  the  funds  in  the  sample.   For  a  few  of  the 
funds  it  actually  becomes  impossible  to  reject  H  ,  even  with  95 
percent  confidence.   However,  the  estimation  mean  and  distribution 
of  outcomes  for  all  eight  tests  seem  to  be  consistent  with  H  .   The 
number  of  outcomes  in  the  two  tails  of  the  distributions  are  approxi- 
mately the  same,  as  is  shown  in  Figures  3-10. 
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FIGURE  8:    TEST  #  6  DISTRIBUTION 


E0.O 


15  0 


10  0 


5.0 


0  C 


0.5 


1.5 


-32- 


FIGURF.  9:    TKST  if    7     DISTRIBUTION 
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Another  problem  that  is  more  difficult  to  deal  with  is  potential 
errors  in  identifying  the  correct  market  forecast.   One  potential 
error  is  due  to  the  discrete  quarterly  timing  of  the  data  used  to 
determine  the  forecasts.   The  adjustment  process  may  differ  from 
the  data  intervals  used. 

An  example  of  this  problem  would  be  as  follows.   The  proportion 
of  the  fund  in  stocks  increased  from  0%  to  50%  from  March  31  to  June 
30,  1980,  thus  indicating  a  forecast  that  the  return  on  the  market 
will  exceed  the  return  from  bonds.   However,  the  proportion  of  the 
fund  in  stocks  may  have  been  100%  on  May  31.   This  would  imply  that 
the  managers  of  the  fund  had  actually  been  reducing  the  proportion  of 
the  fund  in  stocks  over  the  last  month  of  the  quarter,  thus  indicating 
a  forecast  that  bonds  would  outperform  stocks.   Thus,  it  would  be 
useful  to  examine  data  on  the  composition  of  the  funds  more  often  than 
quarterly,  if  such  data  was  available. 

It  may  also  be  true  that  the  market  timer's  forecasting  horizon 
is  shorter  than  three  months.   Then  it  would  be  necessary  to  use 
shorter  observation  intervals,  such  as  monthly  data,  for  actual 
market  returns  in  testing  for  forecasting  ability.   Even  if  the  data 
required  to  determine  the  forecasts  is  not  available  for  less  than 
three-month  intervals,  the  quarterly  forecast  estimates  can  be  tested 
against  the  actual  returns  for  shorter  intervals.   If  the  market 
timing  performance  improves,  it  is  likely  that  the  forecast  horizon 
is  shorter  than  three  months. 

An  even  more  difficult  problem  to  deal  with  is  the  possibility 
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that  investment  managers  have  some  desirable  average  proportion  of 
stocks.   In  the  absence  of  market  forecasting,  one  would  expect  some 
pattern  of  adjustment  back  to  this  average  in  response  to  changes  in 
market  values.   If  such  an  adjustment  process  exists,  there  may  be 
periods  when  it  acts  in  the  opposite  direction  of  the  adjustment  due 
to  the  market  timer's  forecast.   Depending  on  the  magnitudes  of  the 
two  adjustments,  it  may  be  impossible  to  determine  the  market  timer's 
forecast  from  just  the  net  change  in  the  fund's  proportions  of  stocks 
and  bonds. 

To  deal  with  this  problem,  it  is  necessary  to  determine  the 
desired  average  proportions  and  the  pattern  of  the  reversion  adjust- 
ment.  We  could  then  examine  adjustments  independent  of  the  reversion 
adjustment  to  determine  the  forecast.   Simple  tests  along  this  line 
might  use  the  average  proportions  for  the  sample  and  some  sort  of  a 
moving  average  correction. 

None  of  the  identification  problems  would  appear  to  introduce  a 
systematic  bias  to  our  forecast  estimates  as  they  are  just  as  likely 
to  bias  our  forecast  decision  in  either  direction.   However,  it  will 
make  it  more  difficult  to  actually  recognize  market  timing  ability  for 
a  manager  who  actually  can  consistently  beat  the  market.   This  is  the 
result  of  the  noise  introduced  into  our  estimation  by  measurement  error. 

One  possible  way  of  dealing  with  the  measurement  error  problem  is 
to  aggregate  the  forecasts,  under  the  assumption  that  the  errors  of 
the  individual  funds  are  uncorrelated  with  each  other  and  thus  will 
cancel  out  in  the  aggregate.   Unfortunately,  it  is  unlikely  that  the 
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measurement  errors  are  uncorrelated,  especially  with  respect  to  the 
reversion  adjustment  as  changes  in  market  values  will  tend  to  effect 
the  funds  in  the  same  direction. 

Nevertheless,  we  aggregated  the  forecasts  of  all  of  the  funds 
in  our  sample  for  each  of  the  eight  tests.   As  Table  5  shows,  for 
each  of  the  five  tests  using  quarterly  data,  the  aggregate  forecasts 
result  in  estimations  of  p  (t)  +  p  (t)  >  1,  although  in  none  of  the 

J.  ^ 

five  tests  could  we  reject  H  . 

This  seems  surprising  in  light  of  the  previously  reported  results. 
However,  over  the  seven  years  of  the  data  set,  the  performance  of  the 
stock  market  was  streaky;  it  was  common  for  the  relative  performance 
of  stocks,  with  respect  to  riskless  securities,  to  stay  the  same  for  a 
number  of  quarters.   The  mutual  funds  as  a  group  did  quite  poorly  at 
predicting  turning  points.   In  fact,  as  Table  5  also  shows,  the 
aggregate  forecasts  follow  closely  the  relative  performance  of  the 
stock  market  in  the  previous  quarter  or  six-month  period. 

This  may  show  that  investment  managers  follow  a  strategy  of 

13 
relative  strength  selection.   Or  more  likely,  it  may  ^ust  mean  that 

many  of  the  funds  in  the  sample  do  not  fully  adjust  their  portfolios 

in  response  to  changes  in  market  values.   In  either  case,  the  results 

do  not  support  the  hypothesis  that  investment  managers  possess  superior 

market  timing  ability. 
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CONCLUSION 

This  paper  has  developed  the  statistical  framework  to  test  for 
market  timing  ability  using  a  model  where  forecasters  predict  only 
if  stocks  will  provide  a  greater  return  than  bonds  or  if  bonds  will 
provide  a  greater  return  than  stocks.   With  this  model,  a  necessary 
and  sufficient  condition  for  a  market  timer  to  have  superior  forecasting 
ability  is  that  p  (t)  +  P2(t)  >  *  where  p  (t)   and  p2(t)   are  the 
probabilities  of  a  successful  forecast,  conditional  on  the  actual 
return  on  the  market.   Using  changes  in  the  relative  proportions  of 
stocks  and  bonds  held  by  a  mutual  fund  as  a  proxy  for  their  market 
timing  forecast,  we  found  no  evidence  of  superior  forecasting  ability. 

This  model  may  seem  simplistic  in  comparison  with  the  Jenson 
(1972a)  formulation  where  forecasters  predict  the  actual  outcome  of 
the  market  and  performance  is  evaluated  by   p,  the  correlation  coeffi- 
cient between  the  market  timer's  forecast  and  the  actual  returns  on 

the  market  portfolio.   However,  our  nonparametric  formulation  characterizes 
a  more  subjective  approach  to  market  timing  and  only  requires  that  investors 
prefer  more  to  less. 

The  use  of  our  nonparametric  tests  allow  us  to  avoid  most  of  the 
estimation  problems  involved  with  Jenson 's  model.   However,  because 
we  must  estimate  the  forecasts,  we  are  faced  with  possible  errors  in 
our  estimates.   This  is  the  result  of  having  only  quarterly  data  for 
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the  estimation  of  the  forecasts  and  the  possibility  that  the  funds 
follow  some  sort  of  a  mean  reversion  process  in  reaction  to  changes  in 
market  values  that  will  offset  any  action  in  response  to  market  timing. 
Because  of  these  possible  problems,  the  test  results  should  be  considered 
preliminary  with  further  tests  required  to  examine  the  extent  of  these 
potential  errors. 
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FOOTNOTES 


1.  For  a  description  of  the  different  forms  of  the  Efficient  Markets 
Hypothesis,  see  Fama  (1970)  or  Brealey  and  Myers  (1981) . 

2.  The  Capital  Asset  Pricing  Model  (CAPM)  provides  a  framework  for 
the  pricing  of  individual  securities  based  on  homogeneous 
expectations  and  a  mean-variance  criterion  function.   Jenson 
(1972b)  provides  an  excellent  review  of  the  theory  and  empirical 
tests  of  the  model. 

3.  Treynor  and  Black  called  it  the  active  portfolio  because  positions 
in  the  portfolio  were  based  on  special  information  which  typically 
propagates  rapidly  as  the  market  becomes  aware  of  the  information. 
Thus,  this  portfolio  may  experience  a  large  volume  of  trading. 

4.  This  result  was  also  obtained  by  Treynor  and  Black  (1973)  . 

5.  This  test  is  actually  a  special  case  of  a   2x2   contingency 
table  test.   I  thank  Fischer  Black  for  pointing  this  out. 

6.  See  Lehmann  (1975)  theorem  19  for  a  general  proof  that  is  appli- 
cable to  the  hypergeometric  distribution.   I  thank  Arnold  Barnett 
for  pointing  out  this  proof. 

7.  Remember,  this  is  only  a  correct  test  if  one  has  some  strong 
reason  to  believe  that  p  (t)  =  p_(t). 

8.  For  a  sample  of  some  of  the  stated  objectives,  see  the  individual 
mutual  fund  descriptions  in  Weisenberger  Investment  Companies 
Service  (1979) . 

9.  The  term  "bonds"  includes  all  securities,  including  cash  and 
preferred  stocks,  that  are  not  equities  or  common  stocks. 
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10.  Fund  proportion  data  for  12/31/72  was  obtained  from  Weisenberger 
(1979) .   Data  from  3/31/73-3/31/80  from  Computer  Directions 
Advisors,  Inc. 

11.  For  the  market  portfolio,  we  used  the  return,  including  dividends, 
from  holding  a  portfolio  replicating  all  of  the  stocks  on  the 

New  York  Stock  Exchange,  weighted  by  their  relative  sizes.   This 
data  was  obtained  from  the  CRSP  tapes  and  from  the  Wall  Street 
Journal. 

12.  For  Treasury  bills,  we  used  one-month  holding  period  returns  for 
T-bills  with  the  shortest  time-to-maturity  greater  than  one  month. 
The  data  was  obtained  from  the  CRSP  tapes  and  the  Wall  Street 
Journal. 

13.  For  a  discussion  of  this  strategy,  see  Levy  (1967)  and  Jensen 
(1967) .   This  strategy  is  inconsistent  with  any  form  of  the 
Efficient  Markets  Hypothesis. 
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